CLUSTERING NEWS ARTICLES USING K-MEANS AND N-GRAMS
- Project Research
- 1-5 Chapters
- Abstract : Available
- Table of Content: Available
- Reference Style: APA
- Recommended for : Student Researchers
- NGN 3000
ABSTRACT
Document clustering is an automatic unsupervised machine learning technique that aimed at grouping related set of items into clusters or subsets. The target is creating clusters with high internal coherence, but different from each other substantially. Simply, items within the same cluster should be highly similar, while maintaining high dissimilarity with items within other clusters. Automatic clustering of documents has played a very significant role in many fields including data mining and information retrieval. This thesis aimed to improve the overall efficiency of a document clustering technique using N-grams and efficient similarity measure. The thesis improves the purity and accuracy of the obtained clusters. The preprocessing method is based on N-grams (sequence of N consecutive characters) which do not give consideration to stop-words or other special punctuations but creates and overlap among the content of a document which further gives room to ignore errors thereby increasing the quality of the clusters to a great extent. This approach clusters the news articles based on their N-grams representation, thereby reducing noise and increase the probability of occurrences of the sequences within the articles document. The proposed clustering technique has parameters which can be changed accordingly at the document representation level in order to improve the efficiency and quality of the generated clusters. The results from the experiment using R programming environment were carried out on real datasets of the Reuters21578 and 20Newsgropus proved the effectiveness of the proposed clustering technique at different levels of N-grams in terms of the accuracy and purity of the generated clusters. The results also showed that the proposed clustering technique perform averagely better than the baseline technique both in terms of accuracy and purity with a best results when the window of N-grams = 3.
Related Project Materials
EFFECT OF LITTER SIZE ON THE BODY WEIGHT OF RABBIT
BACKGROUND OF THE STUDY
Domestic rabbits are of the descendants of oryctolagus cunniculus specie that i...
TEACHERS AND STUDENTS PERCEPTION OF THE TEACHING OF SEXUALITY EDUCATION IN SECONDARY SCHOOLS
ABSTRACT
This research work sets out to investigate teachers and students perception of the teaching of sexuality educat...
THE IMPACT OF SMALL AND MEDIUM SCALE ENTERPRISES DEVELOPMENT ON YOUTH EMPOWERMENT IN NIGERIA
ABSTRACT
This study was carried out on the impact of small and medium scale enterprises development on youth empowermen...
THE ROLE OF INFORMATION SYSTEMS IN RISK MANAGEMENT
THE ROLE OF INFORMATION SYSTEMS IN RISK MANAGEMENT
Abstract: This study aimed to explore the role...
NON-VIOLENT APPROACH TO INSURGENCY IN NIGER DELTA REGION OF NIGERIA
ABSTRACT
Insurgency and its consequent security challenges in the Niger Delta region have became a matter of global concern. This insurge...
IMPACT OF LEARNING ENVIRONMENT ON THE PERFORMANCE OF STUDENTS IN SOCIAL STUDIES IN JUNIOR SECONDARY SCHOOLS
ABSTRACT
This study examined the Impact of Learning Environment on the Performance of Students in Social Studies in Junior Secondary Scho...
IMPACT OF MENTORSHIP PROGRAMS ON ADULT EDUCATION
Abstract: This study explores the impact of mentorship programs on adult education, focusing on how mentorship enhances learning outcomes for...
CD4+ CELL COUNT AND LEVELS OF SOME CYTOKINES AND HAEMATOLOGICAL PARAMETERS OF PREGNANT WOMEN ATTENDING NNAMDI AZIKIWE UNIVERSITY TEACHING HOSPITAL, NNEWI
Statement of the Problem
Previous studies have shown that normal pregnancy is associated with profound changes in haematological profile...
WOMEN AS VICTIMS OF ENVIRONMENTAL DEGRADATION IN THE NIGER DELTA
Background to the Study
Literature is a carrier and reflector of society which captures the life and essence of a people’s existenc...
THE IMPACT OF PERFORMANCE MANAGEMENT OF THE PROFITABILITY OF MANUFACTURING FIRMS IN NIGERIA
ABSTRACT
The study examined the impact of performance management on the profitability of manufacturing firms in Ni...
